universal learning algorithm
On the Non-Existence of a Universal Learning Algorithm for Recurrent Neural Networks
We prove that the so called "loading problem" for (recurrent) neural net(cid:173) works is unsolvable. This extends several results which already demon(cid:173) strated that training and related design problems for neural networks are (at least) NP-complete. Our result also implies that it is impossible to find or to formulate a universal training algorithm, which for any neu(cid:173) ral network architecture could determine a correct set of weights. For the simple proof of this, we will just show that the loading problem is equivalent to "Hilbert's tenth problem" which is known to be unsolvable. It seems that there are relatively few commonly accepted general formal definitions of the notion of a "neural network".
On the Non-Existence of a Universal Learning Algorithm for Recurrent Neural Networks
We prove that the so called "loading problem" for (recurrent) neural networks is unsolvable. This extends several results which already demonstrated that training and related design problems for neural networks are (at least) NPcomplete. Our result also implies that it is impossible to find or to formulate a universal training algorithm, which for any neural network architecture could determine a correct set of weights. For the simple proof of this, we will just show that the loading problem is equivalent to "Hilbert's tenth problem" which is known to be unsolvable.
- North America > United States (0.30)
- Europe > United Kingdom > England (0.29)
On the Non-Existence of a Universal Learning Algorithm for Recurrent Neural Networks
We prove that the so called "loading problem" for (recurrent) neural networks isunsolvable. This extends several results which already demonstrated thattraining and related design problems for neural networks are (at least) NPcomplete. Our result also implies that it is impossible to find or to formulate a universal training algorithm, which for any neural networkarchitecture could determine a correct set of weights. For the simple proof of this, we will just show that the loading problem is equivalent to "Hilbert's tenth problem" which is known to be unsolvable.
- North America > United States > New York (0.05)
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.05)
- Europe > Netherlands > North Holland > Amsterdam (0.05)
- (3 more...)